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Abstract 

In this paper we give a definition for the Kolmogorov complexity of a pure quantum state. In 
classical information theory the algorithmic complexity of a string is a measure of the information 
needed by a universal machine to reproduce the string itself. We define the complexity of a quantum 
state by means of the classical description complexity of an (abstract) experimental procedure that 
allows us to prepare the state with a given fidelity. We argue that our definition satisfies the 
intuitive idea of complexity as a measure of "how difficult" it is to prepare a state. We apply this 
definition to give an upper bound on the algorithmic complexity of a number of states. 

PACS numbers: 



1 



I. INTRODUCTION AND NOTATION 



Algorithmic information has provided a concise notion of randomness for individual ob- 
jects. It has also revealed deep connections between thermodynamics and the theory of clas- 
sical computation jl?! . The algorithmic complexity (or randomness) of an object -usually a 
binary string- is thereby defined as the length in bits of the shortest program for a universal 
computer that reproduces the string under question 

Quantum theory, on the other hand, has provided a new conceptual basis for the theory 
of computation. Attempts have been made to also generalize the notion of algorithmic 
complexity to quantum mechanical objects, described by states in a Hilbert space. These 
attempts are motivated primarily by the desire to formulate a comprehensive theory of 
quantum information. We may also expect further insights into the theory of entanglement. 

In this paper, we want to characterize the algorithmic complexity of a given quantum 
state. Proposals have already been made by Vitanyi j3| and Berthiaume et al. 0| who 



jorithmic complexity based on the 
I has instead adopted an approach 



have introduced two possible definitions of quantum a 
reproducibility of the state via Turing machines. Gacs |j 
based on universal probability. Our definition will be closer to the one proposed by Vitanyi, 
however deviating from his definition in two crucial aspects. 

To introduce our definition of the algorithmic complexity of a quantum state, we shall 
consider the following scenario. Imagine that Alice has created a certain quantum state in 
her laboratory and wants to describe this state to Bob, who wants to reproduce it in his 
laboratory. How difficult is it for Alice to describe to Bob the state of her system? We 
may distinguish the two situations in which Alice and Bob communicate via a classical or a 
quantum channel, respectively. Depending on the choice of the communication channel, we 
may arrive at different notions of complexity of a quantum state. 

In the first situation, Alice has to use classical information to describe her state to Bob. 
This appears to be a restriction, on first sight. However, we may always regard the quantum 
state of a system as the result of some experimental preparation procedure. The complexity 
of a quantum state is then associated, in a very natural way, with the (classical) description 
complexity of an experimental preparation procedure. The resulting notion of complexity 
might therefore also be called preparation complexity |l8|. 

In the second situation, Alice may use quantum information to describe her quantum 
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state to Bob. In doing this, she has several options. She may send either the quantum state 
altogether to Bob, or a copy (if available), or the state in some Schumacher compressed 
form, or some other quantum state which Bob can transform by into the desired state. If 
we adopt this scenario, we arrive -with Berthiaume et al. j^- at a quite different notion of 
quantum complexity, which might also be called encoding complexity. 

In this paper, we shall follow the first approach and identify the algorithmic complexity 
of a quantum state with its preparation complexity i.e. the classical description complexity 
of the preparation procedure. Although the second approach looks "more quantum", it lacks 
an important feature that we usually associate with the description of an object. Even if 
Bob has the state sent by Alice in his hands, he might not know what state he has received. 
A proper description of the state, on the other hand, will allow him to reproduce the state 
himself 

To be able to communicate, Alice and Bob must first have agreed on a common language 
- a non-trivial problem in linguistics - which they are using to describe their preparation 
procedure. Ideally, they will use the same "toolbox" to compose their experiments and the 
same words when referring to elements of this toolbox. In quantum information theory, 
we abstract from a particular physical system in which a quantum state is realized. The 
experimental toolbox is thereby replaced by a set of elementary operations on a Hilbert 
space with a given tensor-product structure and dimension The toolbox in quantum 

information theory is thus a gross abstraction from an experimental scenario. Here it the 
toolbox will include the possibility to prepare some standard reference state, and a finite set 
of elementary unitary transformations. A complete preparation procedure is then described 
as a sequence of unitary transformations (a quantum circuit) applied to the reference state. 

Considering that a quantum state can be characterized by a circuit with which the state 
can be prepared, we want to define the complexity of a state referring to that of the circuit 
itself. It is known that a finite state of gates (constituting a complete basis) is suitable to 
prepare any state (up to an arbitrary precision); through a sufficient coding, thus, the circuit 
itself can be reduced to a (classical) string whose Kolmogorov complexity is well defined and 
which can be associated to the original state. In this way the algorithmic complexity of a 
state satisfies the intuitive idea of complexity as a measure of "how difficult" it is to prepare 
a state. 
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From now on we will represent with Qjsi the space generated by N qubits and with 
Qn 3 |0) = |0)7v = |0)(i)|0)(2) ■ ■ ■ |0)(A^) the null vector (where |0)(i) G Qf is an element of 
the computational basis {|0)i, |l)i} of Qi'')- 

We will represent with C|0) the result of the application of a circuit C on the null vector; 
if I |v9)C|s?T.n/p > 1 — e we will say that C prepares \^p) with precision e (where < e < 1). 
When saying that C prepares \ip) we mean that C|0) = \ip) . 

In particular we will be interested in building quantum circuits from a fixed set of gates: 
as we want to be able to reproduce any state (at least up to a given precision) this set must 
constitute a complete gate basis. 

Example 1 (Standard basis). An example of a complete gate basis is the so called 
standard basis [3| ^ = {H, S, T, C}, where H is the Hadamard gate, S the phase gate, T a 
|-gate and C the controlled not: 

^ / ^ / ^ / C'|l)|l) = |1)|0) 

T represents a 7r/4 rotation about the z axis, while HTH a 7r/4 rotation around the x axis. 

Given a fixed (finite) number of gates only a countable set of states can be prepared 
exactly. If we consider a complete (finite) gate basis it is though possible to reproduce any 
unitary transformation U (and thus any state \(p)) up to an arbitrary precision. Considering 
that the definition of the complexity of a quantum state will be based on its preparation 
by means of a quantum circuit, it is therefore necessary to introduce a precision parameter 
in such definition. We will nevertheless start defining the algorithmic complexity on the set 
of states that can be exactly prepared with circuits built from a fixed basis. In this case it 
obviously is not necessary to introduce this parameter; it will appear only when generalizing 
this definition to arbitrary states. 

II. CLASSICAL KOLMOGOROV COMPLEXITY 

The definition of algorithmic complexity proposed by Kolmogorov 0, [ll|| is meant to give 
an answer to the question: "Is a (classical) sequence random?" 
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Algorithmic complexity gives a definition of randomness very close to the intuitive idea 
of "structurless" and is based on the concept of algorithmic reproducibility of a sequence. 
In practice, the (classical) Kolmogorov complexity Kqi of a (binary) string uj is defined as 
the length of the shortest program that, running on a universal Turing machine, gives u) as 
output. 

It follows quite easily from the definition that the algorithmic complexity of a string 
uj = oJi^uJi^ ■ ■ ■ can grow at most linarily with the length of <-j: it is in fact always possible 
to reproduce the string by means of a program of the form: ''write uji^ oJi^ - ■ ■ ". 

This actually means that the length of a string constitutes (up to a constant) an upper 
bound for the complexity of the string itself: 

KciM < /(cjj + 0{l) =n + 0{l) . (1) 

Naturally there are sequences for which this upper bound is far too large: it is easilly 
shown, for example, that the complexity of a periodic string grow only logarithmically with 
the length of the sequence. A string is said to be complex (or structureless, or random) 
if its algorithmic complexity grows linearily with its length: these are the strings typically 
generated by random sources (such as, for example, a coin toss). 

We will want to find a "natural" upper bound also for the complexity of a quantum state. 
A difficulty arises from the fact there seems to be no natural quantum counterpart to the 
classical "number of bits in the string". We thus find it necessary to look for another quantity, 
classically related to the number of bits, for which such a counterpart exists. 

In order to do this, let us consider the set of all infinite binary strings: it is easily shown 
that this set is isomorphic to the unit interval [0, 1] j2^. Through this isomorphism it is 
possible to construct a (normalized) measure on the set of infinite strings. Any n-bit binary 
string ujn identifies the set of infinite strings whose first n bits coincide with uj^. the volume 
of this set (a ball, is V(5^J ~ 2"". 

The unit interval is thus divided in \V{Bi^^)Y^ ~ 2" subintervals, each identified by a 
77,-bit sequence uj^n with z = 1, 2, ■ ■ ■ , 2". Once we have numbered all the n-bit sequences 
it follows immediately that each of them can be reproduced by a program that specifies its 
index i, that is, by a program that requires at most (up to some constant) n = — log2~" = 
— log V{Bi^^) bits. This simple "counting" argument gives an upper bound for the complexity 
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of an n-bit string which coincides with the one given by equation (|H): 



(2) 



The advantage of this reasonment is that it can be easily adopted to find an upper bound 
to the complexity of quantum states. 

In the quantum case, in fact, we will be looking at a circuit (or quantum Turing machine 
or any other appropriate model) that reproduces a normalized quantum state \ip) up to a 
fixed (given) precision e. This means that the circuit must prepare some quantum state \ip) 
such that K^/^lv?)!^ > 1 — e: the set of all these states (any of which is acceptable as output 
for the circuit) defines a ball in the 2^-dimensional space Qn, with volume V such that 
V ~ 2~^e^^. This means that if K'^{\(p)) is the complexity of the state \ip) G Qn (when 
reproduced with precision e) we must have: 



In general the linear term can be omitted; we will thus usually consider simply the condition: 



Remark 1. We underline that this is a preliminary condition, that should hold true inde- 
pendently of the way one choses to define quantum algorithmic complexity. It has in fact 
no relation to the model chosen to reproduce the state, but depends instead only on a priori 
propertites such as the dimension of the space where the state is defined and the precision 
with which the state must be reproduced. 

III. ALGORITHMIC COMPLEXITY ON A FIXED SET OF STATES 

In the following section we will assume to have fixed a complete gate basis B = 
{Gi,G2, ■ ■ ■ ,Gk} and we will consider only states \ip) that can be prepared exactly by 
circuits built from B. 

Once we fix a code (that is, an alphabet Q = {uji,uj2, ■ ■ ■ , uji}), the procedure to compute 
the algorithmic complexity of a state \ip) the procedure is very simple. 

1. With the gates contained in the basis B, build a circuit C^{\(f)) such that C^{\ip))\0) = 



K{\if)) < - hgV ^ K%\^)) < -2^ loge + N . 



(3) 



i^^(|^))<-2~log£. 



(4) 
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2. Code the circuit, obtaining a classical sequence uj^{C^) = ujf^^uj^ ■ ■■^^2n symbols 

Remark 2. Most of the code (that is, excluding some parts, e.g. a "new line" instruction 
or a way to identify the different quibits, that will be more or less common to all codes) is 
strictly related to the gate basis. In fact the code can be seen as a function that associates 
each gate of the basis to a symbol (letter) or group of symbols (word). 

4. We have now all the elements to define the algorithmic complexity of a state \ip). 

Definition 1. The algorithmic complexity of a state, relative to the basis B, the code 
Q and the circuit C^{\ip)) is: 



5. In general there are more circuits that prepare the same state \(p), and in principle the 
correspondent complexities can be different. In order to define a property of the state 
itself (and not related to the circuit used to reproduce it) we consider the following 
definition. 

Definition 2. The algorithmic complexity of the state \ip), relative to the code f2 and 
the gate basis B is: 

<f(l^))= min ^f'^'d^)) (5) 
where Cb is the set of all the circuits built with gates from B that prepare \^p). 

Naturally, considering that the choices of code and basis are arbitrary, it is necessary to 
study how they infiuence the complexity of the state. 

Proposition 1 ("Asymptotic" invariance of the complexity of a state for code 
choice). If Vt and £l are two different codes, then, for any state \if) : 

<;?(l^)) = Atf(l^)) + ^n,fi, (6) 

where kfi^Q is a constant that depends only on ^ and 
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This can be seen as follows. For every E ^ let uj^{C^) = cUj^cjj^ ■ ■ ■ tof^ and uj_—{C^) = 
^1^^ ' ' ' be the strings that code using respectively codes Q and Q. 

kn,n represents the length of a "dictionary" with which it is possible to translate the 
description made using one code to that made using the other. Since both codes are finite, 
such dictionary is finite too. The invariance is asymptotical since, in general, k'^ q can be 
very big and its relevance is lost only for K^^'J^dip)) ^ 1 . 

Remark 3. We underline that in general there is no corresponding invariance property 
related to the basis choice (see Sec. IFi)) . Nevertheless there are cases in which such an 
invariance does hold true. This happens, for example, when we consider a coarsening of the 
gate basis, that is if we consider two gate bases B and B_, one of which (B_) constituted of 
non- elementary gates that can be built with gates from B (e.g. B_ containes a Toffoli gate, 
while B contains Hadamard and C-not). In this case, in fact, any circuit made by gates 
from B_ can be reproduced by one made by gates from B. The string that codes this circuit 
will in general be longer than the one that of the original circuit, but their complexities will 
change only for a (small) constant ks^B (that represent the length of a "dictionary" between 
the two gate bases). 

Considering the code-invariance property we can from now on omit explicitating the de- 
pendence on the code (we can imagine to fix it once and for all) and write simply: K^^^{\lp)) . 

IV. ALGORITHMIC COMPLEXITY FOR ARBITRARY STATES 

We want to generalize to arbitrary states what we have seen before. In this case it is 
necessary to introduce the precision parameter e: we can expect, in fact, that the greater 
the precision with which the state must be reproduced by the circuit, the longer will be the 
description of the circuit itself. 

Remark 4. The fact that the description of the circuit becomes longer does not necessarily 
mean that the complexity of the string that codes it(and thus that of the state prepared by 
the circuit) increases. In fact, we can imagine some states that can be prepared with better 
and better precisions by simply iterating the application of a particular gate (or set of gates). 
In this case, the length of the string that codes the circuit would naturally grow with the 
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precision, but not so the complexity of the circuit. However this will not hold true in general, 
so it is necessary to keep the explicit dependence on the precision parameter. 

The precision parameter enters in the definition of the algorithmic complexity of the state 
\ip) at the very first step, that is in building the circuit that prepares it. When considering 
an arbitrary state in the Hilbert space we will in fact need to specify the precision up to 
which the circuit must prepare the state. We will represent with C^{\ip)) a circuit (built 
with gates from B) that prepares \ip) with precision e and with uj^ {C^ {\(p))) the (classical) 
sequence that codes C^{\(p)). 

Definition 3. The algorithmic complexity of state \ip), relative to code ^ and gate basis B 
with precision parameter e is: 

Klfmv))= min Kaiu^^iC^iim), (7) 

cFecB{\^)) 

where C^(|(p)) is the set of all the circuits built with gates from B that prepare \ip) with 
precision e. 

Remark 5. The proof of the code-invariance of the complexity of a state, seen in the pre- 
vious section, did not require that the state was reproduced exactly by the circuits; thus the 
code-invariance property still holds true. Therefore we can again we omit explicitating the 
dependence on the code and write simply: 

• (8) 



V. COMPLEXITY AND PRECISION 



In this paragraph we want to verify that our definition of a complexity satisfies the 
preliminary condition given in Section Ull In order to do this it is necessary to estimate the 
upper bound of the algorithmic complexity of an arbitrary state \ip). 

It is known j3| that using only the (continuous) set of all 1-qubit gates, plus the controlled 
not ((7), it is possible to reproduce any unitary operation U over Qn using O (A^^4^) gates. 
However, if one is interested to reproduce the action of a unitary operation on one particular 
(given) state only O (A^^2^) such gates are sufficient; this number of gates is thus sufficient 
to prepare any state \(p) from the given initial state |0). 
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We consider now the Solvay-Kitaev theorem [l^ which implies that any circuit acting 
on Qn built with m 1-qubit gates and (7s can be reproduced up to precision e using 
O (mlog^ (t^)) gates from a finite gate basis (c G [1,2] is a constant whose exact value 
is yet not known). 

It follows immediatly that the action of any unitary transformation on |0) can be imple- 
mented (and thus any \ip) G Qn can be prepared) up to precision e via a circuit built only 
with gates from any finite and complete basis; futhermore, if M is the number of gates in 
the circuit, we have: 

M = o(^iV22^1og^(^^^^^ ^ M ^ -N^2''\oge , (9) 

where the last expression is given considering only the leading order in the two variables. 

Naturally the length of the string that codes the circuit grows linearly with the number 
of gates of the circuit itself: in order to code a circuit that prepares a general state \(p) G Qn 
we need thus a word whose length is (proportional to) M. Referring to the definition 
given in the previous paragraph, in order to say that a state \ip) is complex it is necessary 
that its complexity (or, equivalently, the complexity of the string uj^{\ip))) grows linearily 
with the length (M) of u)f{\ip)). From Equation © we obtain immediatly the logarithmic 
dependence on precision and the exponential dependence on that were presented in Section 
HHas expected upper bounds for the complexity: we have thus 

KS^l{\v)eQN)<-N'2''\oge. (10) 

Complex states 

noindent We are now in the position of defining what we mean by a complex state. 
Algorithmic complexity is an uncomputable quantity: it is in fact based by definition on the 
classical algorithmic complexity of the string a/VC£) that codes the circuit. As algorithmic 
complexity is an uncomputable quantity (j, luJ, this property passes to algorithmic 



complexity too. 

As defined above, the complexity of a state \(p) is the minimum complexity of a word 
that codes a circuit in C^{\(p)): this means that there is a circuit C^{\(p)) G C^{\(p)), coded 
(using some alphabet) by a>f(| </))), such that K^^^{\ip)) = _K'ci('^f (lv^)))• 
Remark 6. It is in general possible that there are more circuits that satisfy the same condi- 
tion K^'^^{\ip)) = Kffei(C^{\ip))). In this case it is sufficient to chose one of them: the choice 
is arbitrary and not relevant for the following. 
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Once we have associated a classical string (the characterizing string (|v^))) to the state 
\(p) we can introduce the following definition: 

Definition 4. A quantum state \ip) & Qn is said to he complex if the classical string u)^{\ip)) 
is complex. 

As always, a classical string of length A^, is said to be complex if Kci(oj) ~ A^. 

Remark 7. This definition satisfies the intuitive idea of the complexity of a state. Let us 
in fact consider the following situation: Alice has obtained a state (]^)) and wants Bob to 
reproduce it (at least with some precision e). Expecting that a similar situation would arise, 
they had previously agreed on a common code. All that Alice then has to pass to Bob is the 
information on how to compose a circuit that prepares \(p) with the given precision, and this 
means sending Bob the string Lij{Cf{\ip))) that codes the circuit. In this case the complexity 
of the state \lp) measures exactly the minimum amount of information that Alice needs to 
pass to Bob. We underline that this information is not given by the length of the coding 
string, but by its complexity: this simply reflects the fact that a state could be prepared using 
a very big circuit (that will be coded by a consequently long string), but a very simple one 
(again the example of a circuit obtained repeating many times the same set of gates): in 
this case the amount of information Alice needs will be much smaller than the length of the 
coding word. 

VI. THE "BASIS PROBLEM" 

The definition we have given for the algorithmic complexity of a state has a very strong 
dependence on the choice of the basis. Fixing a particular state it is in fact possible to build 
a particular basis so that the description of \ip) is trivial. One could thus argue that the 
definition has no relevant meaning. 

Let us consider again the situation in which Alice prepares a state and wants to describe 
it to Bob. If they have previously agreed on using a certain gate basis, then Alice has only 
to describe to Bob the circuit (that means passing to Bob the sequence ujc)- If they have 
not agreed on a particular gate basis, then Alice could indeed build a circuit using the "best" 
basis, but in this case she would have to describe the basis itself to Bob, and this would be 
in general a similarly difficult task {21I . 
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One might nevertheless wonder whether there is some particular basis that allows to 
describe all (or almost all) states with simple circuits. If such a basis existed, it would 
obviously be convenient for Alice and Bob to agree on using that: in this case we would 
obtain that (almost) all quantum states are non-complex. In the following we will show that 
such a basis cannot exist as, once any gate basis is fixed , the number of non-complex states 
is always small in relation to the total number of states. 

In classical information theory it is well known that the number of compressible (bit) 
strings is "small"; more precisely one has: 

#{a;„ = Uj^ ■ ■■uJi^\Kc\{uJr.} < c} ^ 2" - 1 

Now let us consider the quantum case: as we have seen in the previous paragraphs, once 
we fix a basis B and a precision parameter e, we can associate to every quantum state \(p) a 
(— A^^2^ loge)-bit string u}f{\(p)) whose classical algorithmic complexity coincides with the 
complexity of \(f). Applying Eq. (|TT]l to the set of strings we obtain: 

} ^ 

e 

where with i^{\(p) } we represent the number of different normalized states that can be 

e 

prepared with precision e. Such a relation holds true also in the case when c = c{N, e) is a 
function. State \ip) will be non-complex only if its complexity is o(— A^^2^ lege): this means 
that the right member of the inequality becomes:2^'2^i°s^+°(-^'2^^°g^) ~ 2^'2^^°g-' < 1. 
Thus, applying equation (|T2|l to these states, one obtains that for any fixed basis B, the 
number of non complex states is exponentially small. 



VII. ENTROPY AND COMPLEXITY 

In classical information theory one can consider a random source that emits (with a 
certain probability distribution) letters drawn from some finite alphabet. In this case there 
is a strong relationship between the Shannon entropy of the source and the algorithmic 
complexity of the emitted sequences. In particular, if ujn is a n— letter sequence and pi^u^n) 
is its probability, one obtains [3|: 

\{KciM - H)\ < c , (13) 
12 



where the average is taken over all n-letter sequences, H = — logp(a;„) is the 

Shannon entropy of the source and c is a constant that depends on the probability distribu- 
tion. When such a distribution does not depend on the length of the sequences (as in the 
case of Bernoulli sources), this implies that, in the limit of n 1, the average complexity 
production of the source coincides with its entropy production: 

n— +00 

n n 

It comes quite natural to seek a similar relation in the context of quantum information 
theory. In order to do this, we will first of all find the corresponding relation in the case of a 
classical source that emits words (and not letters) . After that we will define what we intend 
by quantum source and find, in this case, the wanted relationship between complexity and 
entropy. 

A. Classical case 

Let us consider now a variation of the classical letter-source: in this case we will have 
a source that emits, with some given probability, words drawn from a finite dictionary D. 
Each of the words will be a sequence of letters of alphabet A; without loss of generality we 
can assume all words to have the same length /. The output of such a source will thus be a 
sequence of words (or sentence). As the Shannon entropy depends only on the probability 
distribution, once we fix such a distribution it is the same for letter and for word-sources. 
If we consider the complexity of the emitted message, though, it is evident that there must 
be some differences. A word-source that emits m objects will in fact have transmitted a 
sequence of ml letters: it is now easy to believe that the complexity of such a sequence 
can be higher than that of an m-letter sequence (even though letters and words are emitted 
following the same probability distribution). This is an immediate consequence of the fact 
that words are composite objects that have non-zero complexity themselves. 

Naturally, when we consider very long output sentences, such a difference becomes neg- 
ligible. Any sentence can in fact be reduced to a word by a program that associates to each 
word a symbol: the length of this program will be determined by the complexity of the 
dictionary (that is, by the complexity of the single words in the dictionary) and will thus be 
bound by the dictionary length /#-D. This contribution, though, can be extremely relevant 
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while we consider "short" sentences, that is sentences whose length is comparable to that of 
the dictionary. 

Thus, if ftm = <^ii ■ ■ ■ <-<^i,„ is an m— word sentence, its complexity is given by: 

Kciiflm) ^ Kciiim = ii---im) + ^ Kcii^Jj) < Kc\{im) + , (15) 

J=l 

where ik is the symbol that codes cuj^^, and / is the common length of the words uJk ^ D . 

The sequences can easily be seen as the outputs of a letter-source whose entropy H 
coincides with that of the considered word-source: for such sequences, thus, the relation 
expressed by Eq. (fT3|) still holds true. When generalizing it to word-sources, though, it is 
necessary to consider the contribute of the dictionary, obtaining: 

\{Kci{nm) - H) - ^ AciKOI < ci . (16) 
i=i 

Naturally, being the complexity of the dictionary constant, Eq. (fTil) remains of the same 
form for word-sources too: 

m— +00 H 

m m 

B. Quantum case 

Before being able to say anything for the quantum case, it is necessary to specify what we 
will consider as a quantum source. In principle, any mixed state can be viewed as a quantum 
source. In the following, though, we will consider a quantum source as a "black box" that 
emits (with a given probability) pure states drawn from a given set This corresponds 
to considering not a general mixed state, but rather a well defined mixture {{pj, \ fj))}jeD 
of pure states {\(Pj) G Qn)- In this case the source has a kind of "semi-classical" nature: it 
is in fact quantum only in the sense that it emits quantum states and not (as in the cases 
conidered in the previous paragraphs) classical objects, while it cannot, for example, emit 
states that are other than the tensor product of the ones in the ensemble. For these sources 
the Shannon entropy coincides with the Shannon entropy of a classical source that emits 
objects (letters or words) with the same probability distribution {pj}jeD- 

As we have seen when defining the complexity of a quantum state, once we fix a finite 
precision e, it is possible to describe any quantum state by means of a finite word (whose 
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length depend both on the dimension of the Hilbert space in which the state lives and 
on the value of e). This fact allows us to identify a quantum source of this kind with 
a corresponding word-source. The expression for the complexity of the emitted messages 
(tensor-product states) follows thus immediately from what seen above: 

ieD (18) 

<Kc,{im)-i^DN^2''\oge , 
where ik is the symbol that codes state \(pi^). We underline that, in this case, the contri- 
bution due to the complexity of the dictionary can be relevant indeed, being bound by the 
complexity of the states (that can in principle be very large). The relation between the 
entropy H of the source (that is, the Shannon entropy of the probability distribution {pj}j) 
and the complexity of the message is analogously obtained: 

l«;:(l$™)) - H) -J2<eli\^^))\ < ^ ■ (19) 

As in the classical case, though, if we consider the limit of infinitely long state sequences 
the complexity rate and the entropy rate tend to coincides: in this limit, thus, the source 
"reveals" its semiclassical nature. 

Remark 8. Quite naturally one coul ask what happens if we have the possibility to apply 
Schumacher's noiseless coding theorem fl^lj and thus compress the emitted states. If S{p) 
is the von Neumann entropy of the source p = J2jPj\Vj){Vj\! ^^^^^ state can be compressed 
into a new state \(p'j) in a {2^ ^^f'^) -dimensional Hilbert space. In this case we can rewrite 
Eq. (Cg) as: 

<;^(|$„) = ■ ■ ■ 1^,^)) ^ i^J;:(|$'^) = y.M.) ■ ■ ■ l^D) 

~ Kci{im = ^l■■■^m)+Y^ i^^;^(|(^^.)) (20) 
< Kciim) - i^D{N S{p)f 2'''^Phoge . 
VIII. APPLICATIONS AND EXAMPLES 
A. Complexity of copies 

One of the properties of classical algorithmic complexity is that obtaining m copies of 
a given string is (almost) free, being the dependence of the complexity on the number of 
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copies only logarithmic: 

Kciicj^""^ = LJLJ-j-Lj) < KcM + 0{\ogm) . 

m times 

This bound is easilly obtained by considering that, once one has a program that reproduces 
string uj it is sufficient to run it m times to reproduce uj^"^\ 

In the case of a quantum system, the situation is slightly more complex. It is first of all 
necessary to decide exactly what we mean by "preparing m copies" of a quantum state: in 
fact either we will require the circuit to prepare m times a quantum state \(p) G Qn, with 
some fixed precision parameter e, or it must prepare the global state {ip)®"^ G with the 
given precision. The two situations are extremely different. 

In the first case, we obtain the same relation we have seen in the classical case: 



Kl,{\v)- ') = Kl,i\y,) ) < KS:,m + 0{\ogm 



m times 

(m) 

where the expression \if) wants to remind us that each copy of \(f) is reproduced with 

e 

precision e . This is an immediate consequence of the definition of complexity: a circuit that 
prepares |v')|^'"'' can be in fact built by repeating m times the one that prepares with 
precision e. 

If, instead, we require the state \ip)®'^ to be prepared with precision e, the situation is 
different and the classical relation does not (necessarily) hold true any more. In this case 
the relation between the complexity of \ip) and that of ly?)*^™ has the following form: 

K^t,i\^rn < K^'etm + 0{hgm) < -N'2^\og^ . (21) 

This expression follows immediately by the fact that the state \(p)®"^ can be prepared 
with precision e by a circuit C^{\(p)'^"^^ built with m identical copies of a smaller circuit 

The last inequality follows immediately from Eq. (fm . We underline that in most cases 
(that is when Ame^~^ < 1) this bound is much stricter than the one we could obtain by 
directly applying (fTn|) with which one has: K^'^^i]'^)^'^) < loge . 
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B. Entanglement and Complexity 



Let us consider a state \ip) G Qn] suppose it can be written as 

J 

Iv') = Iv^i) ® W'i) ® ■ ■ ■ Iv'j)) with G Qn^ such that dim{Qi^.) = 2^^ , and ''^^Nj = N . 

i=i 

This means that the state \ip) is not totally entangled, and it can thus be considered as the 
tensor product of other (possibly entangled) states \ipj) . 
As a consequence of this fact we have: 

J J 



We want to show that this upper bound is actually stricter than the one obtained for general 

T 



J ^T2nN 



N 2 

states in Qtv: let us rewrite the bound given by Eq. (|Tn|l as K^^^{\lp)) < — — - — lege. 



The wanted inequality is proved by considering: 



Nf2^^ log ^ < iV22^^ 7 ^ ^ 7 < ^ 



e 



Thus, the maximal complexity can be obtained only by a truly A^-party entangled state 
(in the sense that it cannot be written as tensor product of states contained in subspaces of 
Qn)- We stress that this consideration does not imply that all totally entangled states have 
maximal complexity (as a counterexample it is enough to consider the GHZ states). 

It is nevertheless interesting to consider how a property that is characteristic of quantum 
systems (that is entanglement) has direct effect on the complexity of a state. 

Example 2 (Complexity of a completely separable state). As an example let us 
consider a state \ip) G Qn of the form \(p) = (S)j'=i lv^«)' Iv^i) ^ 2i- this case we have: 

N 

thus the complexity of a separable state grows only at most linearily with the number of 
qubits. 

Remark 9. As we have seen, in general the growth of the complexity of a state with the 
number of qubits is exponential, and this is substantially different to what happens in the 
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classical case where the upper bound is linear with the number of bits. In this last example, 
though, we see that the absence of entenglement re-establishes the classical limit: entangle- 
ment thus proves again being a fundamental feature that distinguishes quantum objects from 
classical ones. 

C. Complexity of graph states 

Graph states are multi-particle entangled states that can uniquely be described by math- 
ematical graphs, where the vertices of the graph take the role of qubits and edges represent 
unitary operations between the relative qubits Q]. 

Given a graph G = (V, E) one cane easily prepare the corresponding graph state using 
the following procedure: 

i. prepare all qubits in state |+) = (|0) + |l))/-\/2; 

a. when there is an edge between two vertices k and / apply a controlled-phase gate be- 
tween the two qubits. This actually means applying to the two qubits a transformation 
of the form: Uki = e ^ ~ > . 

The resulting state \iP)g will be an entangled state uniquely described by the graph G. 

Once fixed the number of vertices, there are at most 2^*^^"^)/^ different graphs 
Gi,G2,--- ,G2N(N~i)/2 (each vertex can in fact be connected or not to each other vertex 
by an edge). Correspondingly, given qubits, we can build at most 2^^^"^)/^ different 

graph states |?/;)gi, |^)g2, ■ ■ ■ , l^)G2iv(iv-i)/2 • 

Once we define some sort of lexicographic order in the set of all graphs (or equivalently 
in that of the graph states) only C(A^^) bits are sufficient to specify a determinate state. 
This value constitutes an upper bound for the complexity of a graph state. 

We will now show that this same value can be obtained for the algorithmic complexity of 
a graph state. As seen above in the more general case, the upper bound for the complexity 
of a state is obtained finding a bound for the length (and thus for the complexity) of the 
characterizing string. In the case of graph states this bound is obtained in a simple way: if 
A^ is the number of vertices of the graph, the maximum number of edges is A^(A^ — l)/2. 
This implies that a corresponding graph state can be obtained applying to the A^ qubits at 
most A^ + A^(A^ — l)/2 gates (A^ Hadamard gates, needed to initially prepare all the qubits 
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in state |+), and A^(A^ — \)/2 controlled-phase gates). If G has vertices, we have thus: 
i^Net(l^)G) = Kciu^^{\ij)G)) < K'^^'mG)) < N + N {N - l)/2 < N\ (23) 

As there is no dependence on the precision parameter, Eq. (j^ holds true only if we 
have the possibility to reproduce exactly the controlled-phase and the Hadamard gates. 

It is nevertheless possible to obtain a (more general) upper bound for the complexity of 
this family of states, valid also in the case in which our basis is not of the above type. In 
order to do this we will use some considerations regarding the complexity of sentences, seen 
in section FVII Al 

In order to prepare a graph state only two different types of gates, controlled-phase and 
Hadamard, are sufficient. If these gates cannot be reproduced exactly by those in our basis 
then, naturally, the wanted state can be prepared only with finite precision. As we have 
seen above, we need at most Oi^N"^) of these gates to prepare any arbitrary graph state. To 
guarantee that the desired state is prepared with precision e it is thus enough to reproduce 
each gate with precision e/N"^. From the Solvay-Kitaev theorem we know that implies 
we need to use 0{— log gates to simulate each Hadamard (or controlled-phase) gate. 
Once we code the circuit, to each Hadamard (or controlled-phase) will correspond the same 
0(-log^)-letter word. Using Eq. ^ (where #D = 2) 
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i^Net(|^)G)<iV'-log^. (24) 

Different is the case of weighted graph states Q]. These states are generalizations of graph 
states, in which every edge is specified by a (different) phase. The procedure to prepare these 
states is analogous to that illustrated for graph states; the only difference is that, in this 
case, whenever two vertices k and / are connected, one must now apply a transformation of 
the form Uki = e " ^ ^ ^ ' . 

While the total number of gates in the circuit is still at most 0{N'^), in this case it is 
not sufficient to consider only Hadamard and controlled-phase gates as, in principle, each 
phase-gate could be different. When preparing a weighted graph state it is thus necessary to 
reproduce 0(A^^) different gates with precision C(— log;^). Again we can obtain an upper 
bound for the complexity of these states by using Eq. (|T5|) . only that this time the size of 
the dictionary does depend on A^: #-D ~ A^^. We have thus: 

i^Net(lV') w.G.) <N'-N' log ^ ^ -N' log ^ . (25) 
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IX. CONCLUSIONS AND OUTLOOK 



In this paper we have introduced a new definition for the algorithmic complexity of 
quantum states. We have defined the complexity of a quantum state as the description 
complexity of its experimental preparation via a quantum circuit. We have investigated 
the relation between the Shannon entropy of a source and the algorithmic complexity of 
the emitted message. We could also straightforwardly apply this definition to find upper 
bounds for a number of interesting cases. We have seen a relation between entanglement 
and algorithmic complexity: in particular we have seen that the absence of entanglement 
reduces the upper bound for the algorithmic complexity to the classical one. 

While we have studied the algorithmic complexity of some classes of states, one could 
pursue this investigation analysing other states, for example states that appear in the con- 
ext of quantum phase transition and quantum adiabatic computation Recent results 
l| suggest that it could be possible to construct stricter upper bounds for preparation com- 
plexity of these states. From a broader perspective, it would be interesting to investigate 
further connections between algorithmic complexity and entanglement. 

We want to thank Fabio Benatti for useful discussions and comments. This work has been 
supported in part by the Deutsche Forschungsgemmeinschaft and the European Union (IST- 
2001-38877,-39227). 



Appendix A: Connection with Vitanyi's Complexity 

In |l^ the author proposes a definition of quantum algorithmic complexity based on 
quantum Turing machines. In particular, the algorithmic complexity of a quantum state is 
given by the following expression: 

Kvit(|^)) = min{/(p)+r-log(|(V^|^)|2)l} , (26) 

where the minimum is taken over all programs p (in classical bits) running on a universal 
Turing machine U and such that U{j>, |<yCo)) = 1"^) (where |v?o) is the initial state of the com- 
puter), and l{p) is the (classical) length of the program. The complexity of \ip) is therefore 
constituted of two separate terms: the length of a program describing an approximation \'ip) 
to \ip) and a term penalizing for a bad approximation. 
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The author shows that, if Iv^) € Qtv, then 2N is an upper bound for i^vitdv^))- This 
is easilly obtained considering the projections of \(p) over the vectors of a basis: being \ip) 
normalized, there exists at least one vector \ej) such that |(e-,|v9)p > 1/2^: the length of 
a program that gives |ej) as output is at most n and the corresponding value for + 
[-log(|(^/'|(^)n] is exactly 2N . 

The required upper bound for the complexity of a state |(/?) is thus obtained when the 
output state satisfies the condition Kt/'Ic/?)^ > 1/2^. Such condition can be easily 
rewritten in terms of a precision parameter evit as: K^/'jc/?)!^ > 1 — evit with evit = 1 — 1/2^. 
Rewriting the expression for the upper bound in this particular case (and considering the 
case 1/2^ ^ 1) we have: 

^vit (I ) < 2^ log evit + iV ~ iV . 

To find this expression it is necessary to consider the complete expression for the upper 
bound given in Eq. Q. We see thus that the definition given by the author satisfies the 
preliminary condition introduced in section El 

With this value of the precision parameter e, for the algorithmic complexity of a state we 
have: 

This bound is larger than the one that characterizes Vitanyi's complexity; such a difference 
is only polynomial. 

Appendix B: Quantum algorithmic complexity of a classical string 

We naturally want to see if our definition is coherent with that of classical Kolmogorov 
complexity. In order to do this we consider a classical iV-bit string x = Xi^Xi^ ■ ■ ■ Xi^ (where 

E {0,1}). 

In order to use a procedure built to characterize complexity of quantum state it is nec- 
essary to "translate" the classical string into a quantum state; this is easily done simply 
considering the state |x) = \xi-^^)\xi^) ■ ■ ■ \xi^), with \xi^) G {|0), |1)}. 

Considering the nature of this state it is trivial to see that it can be obtained from the 
initial state |0)|0) ■ ■ ■ |0) by simply applying one-qubit NOT gates to the bits corresponding 
to \xi^) = |1) and leaving invaried (applying the identity transformation) the bits = |0). 
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To encode these particular circuits, thus, 3 symbols are enough 

/ ^ identity 
N ^ NOT gate 
L ^ NEWLINE . 

Let us consider now a simple example: 

Classical string x = 1011010 
Quantum state |x) = |1) |0) |1) |1) |0) |1) |0) |0). 

Qubit Initial Tiiinsfoimation Final 



1 o) NOT l) 

2 o) Id o) 

3 o) NOT l) 

4 o) NOT l) 

5 o) Id o) 

6 o) NOT l) 

7 o) Id o) 

8 o) Id o) 




After coding, then, we have the following string representing the circuit: 

a;(C) = N L I L N L N L I L N L I L I L 

(where, to help visualization, we have put larger spaces after line breaks L). It is evident 
that there is a direct correspondence between uj{C) and the original classical string x: in 
fact, a program that reproduces x reproduces also <-i;(C) (with the agreement that ^ / and 
1 ^ A^) (it will be enough to add a constant part that tells the program to insert a line-break 
after every simbol). Thus it follows immediatly that the (classical) Kolmogorov complexity 
of oj{C) coincides with that of x. Considering the definition of the network complexity we 
have immediatly: 

A'Net(|x))~A:ci(x) . (27) 
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Naturally the exact procedure followed in the example can be applied to any A^-bit string x 
so the result is true in general. 
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